Product Code Database
In signal processing, a nonlinear filter is a filter whose output is not a linear function of its input. That is, if the filter outputs signals and for two input signals and separately, but does not always output when the input is a linear combination .
Both continuous-domain and discrete-domain filters may be nonlinear. A simple example of the former would be an electrical device whose output voltage at any moment is the square of the input voltage ; or which is the input clipped to a fixed range , namely . An important example of the latter is the median filter, such that every output sample is the median of the last three input samples . Like linear filters, nonlinear filters may be shift invariant or not.
Non-linear filters have many applications, especially in the removal of certain types of noise that are not additive noise. For example, the median filter is widely used to remove spike noise — that affects only a small percentage of the samples, possibly by very large amounts. Indeed, all use non-linear filters to convert kilohertz to gigahertz signals to the Sound frequency range; and all digital signal processing depends on non-linear filters (analog-to-digital converters) to transform to .
However, nonlinear filters are considerably harder to use and design than linear ones, because the most powerful mathematical tools of signal analysis (such as the impulse response and the frequency response) cannot be used on them. Thus, for example, linear filters are often used to remove noise and distortion that was created by nonlinear processes, simply because the proper non-linear filter would be too hard to design and construct.
From the foregoing, we can know that the nonlinear filters have quite different behavior compared to linear filters. The most important characteristic is that, for nonlinear filters, the filter output or response of the filter does not obey the principles outlined earlier, particularly scaling and shift invariance. Furthermore, a nonlinear filter can produce results that vary in a non-intuitive manner.
For almost any other form of noise, on the other hand, some sort of non-linear filter will be needed for maximum signal recovery. For multiplicative noise (that gets multiplied by the signal, instead of added to it), for example, it may suffice to convert the input to a logarithmic scale, apply a linear filter, and then convert the result to linear scale. In this example, the first and third steps are not linear.
Non-linear filters may also be useful when certain "nonlinear" features of the signal are more important than the overall information contents. In digital image processing, for example, one may wish to preserve the sharpness of silhouette edges of objects in photographs, or the connectivity of lines in scanned drawings. A linear noise-removal filter will usually blur those features; a non-linear filter may give more satisfactory results (even if the blurry image may be more "correct" in the information-theoretic sense).
Many nonlinear noise-removal filters operate in the time domain. They typically examine the input digital signal within a finite window surrounding each sample, and use some statistical inference model (implicitly or explicitly) to estimate the most likely value for the original signal at that point. The design of such filters is known as the filtering problem for a stochastic process in estimation theory and control theory.
Examples of nonlinear filters include:
Nonlinear filter also occupy a decisive position in the image processing functions. In a typical pipeline for real-time image processing, it is common to have many nonlinear filter included to form, shape, detect, and manipulate image information. Furthermore, each of these filter types can be parameterized to work one way under certain circumstances and another way under a different set of circumstance using adaptive filter rule generation. The goals vary from noise removal to feature abstraction. Filtering image data is a standard process used in almost all image processing systems. Nonlinear filters are the most utilized forms of filter construction. For example, if an image contains a low amount of noise but with relatively high magnitude, then a median filter may be more appropriate.
Ruslan L. Stratonovich (1959), ''Optimum nonlinear systems which bring about a separation of a signal with constant parameters from noise''. Radiofizika, volume 2, issue 6, pages 892–901.
Ruslan L. Stratonovich (1959). ''On the theory of optimal non-linear filtering of random functions''. Theory of Probability and Its Applications, volume 4, pages 223–225.
Ruslan L. Stratonovich (1960), ''Application of the Markov processes theory to optimal filtering''. Radio Engineering and Electronic Physics, volume 5, issue 11, pages 1–19.
Ruslan L. Stratonovich (1960), ''[https://www.sciencedirect.com/science/article/pii/B9781483232300500419 Conditional Markov Processes]''. Theory of Probability and Its Applications, volume 5, pages 156–178.
and Harold J. Kushner.
Kushner, Harold. (1967), [https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/19670016624.pdf Nonlinear filtering: The exact dynamical equations satisfied by the conditional mode]. IEEE Transactions on Automatic Control, volume 12, issue 3, pages 262–267
The optimal filter SPDE is called Kushner equation.
In 1969, Moshe Zakai introduced a simplified dynamics for the unnormalized conditional law of the filter known as Zakai equation.
Moshe Zakai (1969), On the optimal filtering of diffusion processes. Zeitung Wahrsch., volume 11, pages 230–243.
It has been proved by Mireille Chaleyat-Maurel and Dominique Michel
Chaleyat-Maurel, Mireille and Dominique Michel (1984), [https://www.tandfonline.com/doi/abs/10.1080/17442508408833312 Des resultats de non existence de filtre de dimension finie]. Stochastics, volume 13, issue 1+2, pages 83–102.
that the solution is infinite dimensional in general, and as such requires finite dimensional approximations. These may be heuristics-based such as the extended Kalman filter or the assumed density filters described by Peter S. Maybeck
Peter S. Maybeck (1979), ''Stochastic models, estimation, and control.'' Volume 141, Series Mathematics in Science and Engineering, Academic Press
or the projection filters introduced by Damiano Brigo, Bernard Hanzon and François Le Gland,
Damiano Brigo, Bernard Hanzon, and François LeGland (1998) [https://hal.inria.fr/hal-02101519/document A Differential Geometric approach to nonlinear filtering: the Projection Filter], IEEE Transactions on Automatic Control, volume 43, issue 2, pages 247–252.
some sub-families of which are shown to coincide with the assumed density filters.
Damiano Brigo, Bernard Hanzon, and François LeGland (1999), ''Approximate Nonlinear Filtering by Projection on Exponential Manifolds of Densities'', Bernoulli, volume 5, issue 3, pages 495–534
are another option, related to sequential Monte Carlo methods.
The size and shape of the neighborhood are defined by a structuring element, typically a square or circular mask.
The transformation replaces the central pixel with the darkest one in the running window.
For example, if you have text that is lightly printed, the minimum filter makes letters thicker.
It replaces each pixel in the image with the maximum value of its neighboring pixels, again defined by a structuring element.
The maximum and minimum filters are shift-invariant. Whereas the minimum filter replaces the central pixel with the darkest one in the running window, the maximum filter replaces it with the lightest one.
For example, if you have a text string drawn with a thick pen, you can make the sign skinnier.
|
|
